f\b")3ns3o 


DEPARTMENT  OF  STATISTICS 

The  University  of  Wisconsin 
Madison ,  Wisconsin 


TECHNICAL  REPORT  NO.  276 
August  1971 

MAXIMUM  LIKELIHOOD  ESTIMATION  AND 
HYPOTHESIS  TESTING  IN  THE  BIVARIATE 
EXPONENTIAL  MODEL  OF  MARSHALL 
AND  OLKIN 

By 

G.K.  Bhattacharyya 
and 

Richard  A.  Johnson 
University  of  Wisconsin 


1 26.  CROUP 


Security  Clasp*  ties  tlon  _ _ - _ _ _ 


DOCUMENT  CONTROL  DATA  -RAD 

(S+curitf  tio*  of  tHI».  tody  of  mbmlrmct  mnd  mmoftion  muaf  6a  •nfri§  wht%  ih»  oM/«!i  rtporf  l»  clmtmltlmd) 


I  OR  1GIN  A  Ti  NG  ACT  I  VI  TV  (CPPMfi  «U<JkO*J  M.  HtPOHT  JSCUNITV  CLAS9IRICATION 

University  of  Wisconsin  »  I  UNCLASSIFIED 

Department  of  Statistics 

n  #44  or\“n 


3  REPORT  TITUS 

MAXIMUM  LIKELIHOOD  ESTIMATION  AND  HYPOTHESIS  TESTING  IN  THE 
BIVARIATE  EXPONENTIAL  MODEL  OF  MARSHALL  AND  OLKIN 


4-  descriptive  NOTH  (Typ»  of  rmpatt  an*  IMlialw  Mlu) 

Scientific  Interim 


s  authoRISI  fflnl  HUM,  at Min  WlM,  Uil 

Gouri  K.  Bhattacharyya 
Richard  A.  Johnson 


4-  REPORT  OATE 


IA  CONTRACT  OR  CRANT  NO 

AFOSR  69-1789 

h  NNOJtCT  NO. 


9749 
61102F 
*  681304 


to.  DISTRIBUTION  statement 

A.  Approved  for  public  release  distribution  unlimited. 


TOTAL  MO.  OP  PAGES 

30 

to.  MO.  OP  REPS 

8 

ER|»> 

to.  OTHER  REPORT  NOISI  (Any  gEMr  noatm  Pal  mar  to  aaalmiad 

Ma  rapati) 

AFDSR  -1R-72  -0494 

•  2.  OR  ON  SORING  MILITARY  ACTIVITY 

Air  Force  Office  cf  Scientific  Research /N1 
1400  Wilson  Blvd 
Arlington,  Virginia  22209 


tV  AaitRKT 


, .  .  .p1®. Present  work  concerns  statistical  inference  in  the  bivariate  exponential 
^•nmu^Utr0n  intr°dl,p®d  b'>'  ^^shall  and  01  kin.  Even  thouoh  the  distribution 'has  a 

fom  If  tS  HM-h  the  USe  °f  a  SDecia1  dominating  measure  leads  to  an  explicit 
form  of  the  likelifiooc  whose  nronerties  are  investinated.  The  existence  unioueness 

^tudiedmPtMc-C  d^tr^utional  oroperties  of  the  maximum  likelihood  estimators  are 
studied  Using  the  criterion  of  generalized  variance,  it  is  shown  that  the  simple 
unbiased  estimators  oroposed  by  Arnold  are  asymototicall v  less  efficient  than  the 
maximum  likelihood  estimators  and  the  loss  in  efficiency  is  oanicullrly  serious 

^».iheHC^Se  1ndcp<rn<Jenca-  Uniformly  most  oowerful  test  for  independence  is 
derived  for  the  special  model  having  identical  marginal  distributions. 


DEPARTMENT  OF  STATISTICS 


The  University  of  Wisconsin 
Madison,  Wisconsin 


TECHNICAL  REPORT  NO.  276 
August  1971 

MAXIMUM  LIKELIHOOD  ESTIMATION  AND 
HYPOTHESIS  TESTING  IN  THE  BIVARIATE 
EXPONENTIAL  MODEL  OF  MARSHALL 
AND  OLKIN 

By 

G.K.  Bhattacharyya 
and 

Richard  A.  Johnson 
University  of  Wisconsin 


V  ", 


'■i 


« t 

b  v 


Typist:  Jacquelyn  R.  Jones 


m 

JUtEisv;  • 


This  work  was  supported  by  the  Air  Force  Office  of  Scientific  Researc 
under  Grant  AFOSR  69-1789. 


Approved  far  public  roieci** 
DtattibatJon  Ui  limited  '  jf 


Maximum  Likelihood  Estimation  and  Hypothesis  Testing 
in  the  Bivariate  Exponential  Model  of  Marshall 

and  Olkin 

By 

G.K.  Bhattacharyya  and  Richard  A.  C  ihnson 
University  of  Wisconsin 

ABSTRACT 

The  present  work  concerns  statistical  inference  in  the 
bivariate  exponential  distribution  introduced  by  Marshall 
and  Olkin.  Even  though  the  distribution  has  a  singular 
component,  the  use  of  a  special  dominating  measure  leads  to 
an  explicit  form  of  the  likelihood  whose  properties  are 
investigated.  The  existence,  uniqueness  and  asymptotic 
distributional  properties  of  the  maximum  likelihood  estimators 
are  studied.  Using  the  criterion  of  generalized  variance, 
it  is  shown  that  the  simple  unbiased  estimators  proposed  by 
Arnold  are  asymptotically  l^ss  efficient  than  the  maximum 
likelihood  estimators  and  the  loss  in  efficiency  is  particularly 
serious  in  the  case  of  independence.  Uniformly  most  powerful 
test  for  independence  is  derived  for  the  special  model  having 
identical  marginal  distributions. 
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1.  INTRODUCTION  AND  SUMMARY 

From  reliability  considerations,  Marshall  and  Olkin  [6] 
formulated  a  multivariate  analog  of  the  exponential  distribution 
as  a  realistic  model  for  a  system  wher.  the  component  life 
times  may  be  dependent  due  to  shocks  affecting  two  or  more 
components  simultaneously.  In  their  bivariate  model,  two 
components  A  and  B  in  a  system  are  subject  to  three  types  of 
shocks  which  occur  independently  according  to  Poisson  processes 
with  intensity  parameters  X2  and  6  respectively.  The 
first  (second)  type  of  shock  affects  only  the  component  A  (B) 
while  the  third  type  of  shock  causes  the  failure  of  both  A 
and  B  so  that  their  life  times  Y^  and  Y2  will  be  dependent 
when  6>0.  It  is  shown  in  (6]  that  the  joint  distribution  of 
(Y^ » Y2)  has  the  right  hand  cdf 

F(yi,y2)  *  P(Y1>yl,Y2>y2)  *  expC-A^  -  X2y2  -  6max (y^y^ ) 

for  v J/Y2  >  n*  (1.1) 

Some  properties  of  this  distribution  including  the  moment 
generating  function,  the  distribution  of  min(Y^,Y2),  etc.  are 
studied  in  16]  and  a  natural  extension  to  higher  dimensions 
is  also  presented. 


Although  developed  from  a  Poisson  shock  model  analogously 
to  the  univariate  exponential  distribution,  an  analytical 
treatment  of  this  bivariate  exponential  distribution  is  made 
difficult  by  the  existence  of  a  component  which  is  singular 
with  respect  to  the  two-dimensional  Lebesgue  measure.  Several 
authors  [1],  [2],  [4]  have  mentioned  this  difficulty  particularly 
in  the  context  of  maximum  likelihood  estimation.  Problems  of 
parameter  estimation  and  testing  certain  hypotheses,  based  on 
a  random  sample  =  *Yii'Y2i^'  i®1'****11  from  (1.1),  have 
been  considered  by  Arnold  [1]  and  George  [4] .  Due  to  the 
difficulty  of  explicitly  writing  out  the  likelihood  function, 
both  authors  start  with  an  initial  reduction  of  the  data  to 


n 

T1  =  Z^min(Yli,Y2i) ,  Nx 


#  (Y 


li 


Y2i> 


N,  =  #<YU 


Y2i>, 


NA  =  #(Y 


li 


=  Y2i> 


(1.2) 


where  the  symbol  #  ("•")  denotes  the  number  of  vectors  Y^ 
satisfying  the  statement  " •" .  The  counts  (Nq,N^,N2)  have  a 
multinomial  distribution  and  are  independent  of  which  has 
a  gamma  distribution.  Based  on  this  fact,  unbiased  estimators 
of  X^,  X2  and  o  are  obtained  in  flj  and  likelihood  ratio  tests 
are  formulated  in  14).  However,  aside  from  having  a  convenient 
distribution,  (NQ ,N^ ,N2 ,T^)  does  not  constitute  a  sufficient 
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for  (1.1)  and  therefore  this  reduction  involves  some  loss  of 
information.  In  this  paper,  we  study  procedures  based  on  the 
complete  random  sample  and  its  reduction  to  sufficient 
statistics. 

A  mixture  of  one-  and  two-dimensional  Lebesgue  measures 
is  used  in  Section  2  as  a  dominating  measure  which  leads  to 
a  joint  density  function  and  minimal  sufficient  statistics. 

The  distributional  properties  of  the  sufficient  statistics 
are  studied  and  the  lack  of  completeness  is  demonstrated  for 
the  case  of  identical  marginals.  Maximum  likelihood  estimators 
(MLE)  are  investigated  in  Section  3.  It  is  shown  that  the  MLE 
is  realized  as  the  unique  root  of  the  likelihood  equation 
except  in  a  subset  of  the  sample  space  where  it  does  not  exist 
or  is  not  unique.  The  probability  of  this  set  however  tends 
to  zero  with  increasing  sample  size.  The  structure  of  the 
MLE  is  compared  with  the  simple  unbiased  estimators  proposed 
by  Arnold  tl)  and  the  asymptotic  distribution  of  both  estimators 
are  obtained.  Using  the  criterion  of  generalized  variance, 
the  asymptotic  efficiency  of  the  unbiased  estimators  relative 
to  the  MLE  is  derived  and  bounds  of  this  efficiency  are 
studied. 

A  case  of  particular  interest  in  the  model  (1.1)  is  the 
one  having  identical  marginal  distributions,  that  is 
Thi3  model  fits  real  life  situations  where  the  components 
which  are  connected  in  parallel  in  a  system  are  similar  in 
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nature  and  are  likely  to  experience  the  same  sort  of  shocks 
component-wise  In  addition  to  occasionally  being  simultaneously 
affected  by  some  catastrophic  shocks.  Since  independence  of 
life  times  introduces  substantial  simplification  in  system 
reliability  studies,  in  Section  4  we  consider  the  problem  of 
testing  for  independence  (6*0)  in  this  model.  Using  the 
concept  of  a  least  favorable  distribution,  the  uniformly  most 
powerful  (UMP)  test  for  independence  is  derived  in  a  convenient 
form.  The  proof  indicates  a  strong  optimality  of  some  other 
tests  in  reliability  studies.  For  instance,  when  testing  for 
the  equality  of  scale  parameters  in  two  exponential  distribu¬ 
tions  against  one  sided  alternatives,  the  usual  F  test  is  UMP 
rather  than  just  UMP  unbiased  and  the  same  property  holds 
even  for  censored  samples. 

2.  LIKELIHOOD,  SUFFICIENCY  AND  COMPLETENESS 

Let  (YjyY^  have  the  Divariate  exponential  cdf  given  by 
(1.1)  and  denote  this  distribution  by  BVE  (XirX2,6)  where  the 
parameter  space  is  R  «  {(X^,X2,5):  0<X^<»,  i-l,2j  0<5<“>). 

In  order  to  obtain  its  probability  density  function  (pdf) , 
we  consider  the  Lebesgue  measure  y2  on  (R2 '  )  where  R2  is  the 

positive  orthant  of  the  (y1#y2)  plane  and  is  the  corresponding 
Borel  o-field.  In  order  to  handle  the  singular  component,  we 


-6- 


define  another  measure  v  on  (R^ ,  )  as  follows:  let  CQ»{ (x,x) : 

0<x<"}  be  the  diagonal  line  in  and  for  Borel  sets  B  R*, 
set  v(B)  *  y^Ux:  (x,x)eB  CQ})  where  y^  is  the  Lebesgue 
measure  on  the  real  line,  v  is  a  a-finite  measure  on  (R2 ,  ) 

and  is  singular  with  respect  to  y 2>  Finally,  we  let  y=y2+v 
on  <R+,  )  and  note  that  the  probability  measure  determined 

by  (1.1)  is  absolutely  continuous  with  respect  to  the  measure 

y . 

Let  C1  -  {(y1,y2):  0<y1<y2<»)  and  C2  =  l(y1,y2)i  0<y2<y1<»} 

be  the  subsets  of  R+  which  are  above  and  below  the  diagonal 

+  2 

respectively  so  that  R_  =  U  C  .  Then,  from  the  properties 

a=0 

of  the  distribution  (1.1)  discussed  in  (61,  we  observe  that 
a  determination  of  the  pdf  of  (Y^,Y2) ,  with  respect  to  y, 
is  given  by 

f(y1,y2)  =  Sa=ofa(yry2)IC  (yl'y2}  (2-1) 

a 

where 

f0tyl'y2*  *  6  exp(-(X1  +  X2  +  6^1 

fl(yl'y2)  =  ^1(x2+6)expt*Xlyl  “  X2y2  "  6y2J 
f2(yl'y2)  “  x2  (Xl+lS)expI“Xlyl  *  X2y2  "  6ylJ 


(2.2) 
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and  I  is  the  indicator  of  the  set  appearing  in  its  suffix. 

The  joint  pdf  of  the  random  sample  Y.  =  (Y. . ,Y_ . ) ,  i=l,...,n 

...  -1  J.X  4I 

n 

is  then  the  product  n  f(y1.#y0.)  where  f  is  defined  by 

i=l  11 

(2.1)  and  (2.2).  To  simplify  the  expression,  we  introduce 
the  following  notations: 


no  "  Ei=lIC  (yli'y2i}'  a=0'1'2'  sa  ~  Ei=lyai'  a=s1'2 


n 


wli  “  min  (yii^2i)  '  w2i  "  raax<yli'y2i*  ' 


(2.3) 


n 


tl  ~  if^li'  t2  =  if1W2i'  v  *  t2  ~  fcl' 


Thus  nQ,n^  and  n2  are,  respectively,  the  number  of  points 
which  are  cn,  above  and  below  the  diagonal  line  so  that 
n0+ni+n2  “  n«  Also  we  have  s^+s2  =  +:i+t2*  N°ting  that, 
for  every  point  (y-^yj)  in  R*,  exactly  one  term  in  the  r.h.s. 
of  (2.1)  is  non-zero,  the  likelihood  function  simplifies  to 
the  form 


t(x.,x.f6)  =  n  f(y..,y,.)  =  n  n  f  iYn»yo<> 


i=l 


a=0  y.ECa 


n_  n 


[X1(X2+6)1  1[X2(X1+«S)J  2 6  °exp(-X1s1  -  X2s2  -  6t2) 


for  (X^,X2,6)  e  ft. 


(2.4) 


-8- 


For  the  case  6=0,  the  above  functional  form  holds  provided 
we  interprete  0°=1.  The  likelihood  in  this  case  is  then  0 
if  ng>0  and  (X^X2) nexp [-X^s^  -  *2S2^  ^  nQ=0. 

From  the  factorization  criterion,  it  follows  that  a  set 
of  sufficient  statistics  is  given  by  {N]/N2'S1,T1'T2^  or, 
equivalently,  by  (N^,N2,S^,T^,V)  where  the  components  are 
defined  in  (2.3)  using  small  letters.  The  minimality  of  this 
sufficient  statistics  follows  from  the  usual  partitioning 
operation  of  the  sample  space  (c.f.  [8],  p.  50).  For  the 
subfamily  of  (1.1)  with  6-0,  a  minimal  sufficient  statistic 
is  (S^,S2)  since  N2=0  with  probability  1.  This  is  al3o  clear 
from  the  fact  that,  in  this  subfamily,  Y1  and  Y2  are  independent 
and  exponentially  distributed. 

In  the  special  subfamily  of  (1.1)  having  identical 
marginals,  we  denote  the  common  parameter  Xj=X2  by  ®  and  the 
parameter  space  by  »  {(8,6):  0<8<°®,  0<6<«}.  The  likelihood 
function  is  then  given  by 

n-n0  nQ 

i*  (8 ,6)  *  (6(8+6)]  u6  uexp(-8(t1+t2)  -  5t2] , 

(8,5)  e  (2.5) 

and  (Nq ,T^ , V)  constitutes  a  set  of  minimal  sufficient 
statistics . 

We  now  list  some  distributional  properties  of  this 
sufficient  statistics  for  future  reference,  particularly  for 
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Section  4  where  we  consider  hypothesis  testing  in  this 
subfamily.  For  abbreviation  we  shall  write  "X  is  G(n,8)”  to 
mean  that  X  has  a  gamma  distribution  with  p.d.f.  *  exp[-0x]xn 
0<x<«  and  the  corresponding  cdf  will  be  denoted  by  G(x;  n,8) . 

Theorem  2.1.  Let  Y i«l,...,n  be  a  random  sample  from 
BVE(B,8,6)  and  let  Ng,  T^,  V  be  defined  as  in  12.3),  then 
the  following  hold: 

(a)  T^  i£  G(n,  28+6)  and  is  independent  of  (NQ,V) 

(b)  Nq  and  V  jointly  have  the  mixed  distribution  given  by 

P(NQ=k,  V<v)  =  {JJ)pk(l-p)n_kG(vj  n-k , 8+6 ) 

if  k=0 , . . . ,n-l 

»  pn  if  k=n  (2.6) 

where  0<v<°°,  and  p=6/(2B+6)  is  the  probability  mass  on 
the  diagonal  for  a  single  observation. 

(c)  Conditionally  given  n^O,  V  i£  G(n,8+6)  . 

The  property  (a)  holds  even  in  the  general  case  of  non¬ 
identical  marginals  in  which  case  28+6  is  to  be  replaced  by 
\l+A2+6.  The  distribution  of  T^  has  already  been  noted  in 
(61.  Independence  of  Tx  and  (NQ,V)  can  be  verified  by  using 
(2.1)  and  (2.2)  to  write  out  the  joint  pdf  of  and 
Vi»W2i~Wli  and  then  factoring  the  pdf  of  and  V..  Since 
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T^*ZW^,  V*ZV^  and  Nq*#(Vj«0),  the  result  follows.  To 

establish  (b)  ,  one  needs  to  write  P(Ng=*k,  V<v)  *  P (NQ»k)P (V<v|N0*k) 

and  note  that  when  k«n,  V  has  the  constant  value  0  and  for 

n-k 

any  k<n,  V  is  the  sum  of  (n-k)  terms  7  V.  where  V.,...,V 

j,l  ij  in 

are  i.i.d.  G(l,3+6)  and  (i^,...,in)  is  a  permutation  of  the 
integers  (l,...,n).  (c)  follows  immediately  from  (b) . 

The  following  moments  are  obtained  from  the  distributions 
stated  in  Theorem  2.1  using  the  properties  of  gamma  distribution. 

E (T^)  «  n{20+5)“1 
E  (N_T. )  *  n26(26+6)"2 

0  1  (2.7) 

E  (V)  *  E(E(V|N0))  *  2nB(B+6)‘1(2B+6)“1 

E(VNq)  =  2n(n-l)S<S  (B+6)-1(2B+6)“2. 

For  the  family  BVE(6,<5,8),  we  note  that  although  the  parameter 
space  is  two-dimensional,  the  minimal  sufficient  statistic 
obtained  above  has  three  components.  To  prove  that  the 

i 

sufficient  statistic  is  not  complete  we  consider  the  statistic  _j 

1 

1 

T*  *  V(n+NQ-1) (4n(n-l) ]_1  -  Tx  (n-NQ) [2n2) .  (2.8) 

I  i 

By  using  the  moments  in  (2.7)  it  is  easy  to  verify  that  each  |! 
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_2 

estimator  of  8(28+6)  so  that  T*  is  an  unbiased  estimator 
of  0.  Since  T*  is  not  identically  0,  the  statistics  (NQ,T^,V) 
is  not  complete.  Although  the  unbiased  estimators  constructed 
by  Arnold  (1]  are  functions  of  Ng  and  T^,  the  lack  of  complete 
ness  prevents  one  from  concluding  that  these  have  minimum 
variance.  In  the  general  model  BVEfA^X^S)  where  the 
parameter  space  is  three  dimensional,  the  minimal  sufficient 
statistics  have  five  components.  It  is  unlikely  that  these 
sufficient  statistics  are  complete  but  we  have  not  been  able 
to  prove  it. 


3.  MAXIMUM  LIKELIHOOD  ESTIMATION 

This  section  is  devoted  to  the  derivation  and  study  of 
the  asymptotic  properties  of  the  MLE  for  the  parameters  of 
the  general  model  BVE(X^,A2,5)  as  well  as  for  the  special 
model  having  identical  marginals.  The  use  of  the  dominating 
measure  u,  introduced  in  Section  2,  permits  an  explicit 
functional  representation  of  the  likelihood  whose  properties 
are  readily  studied.  The  investigation  brings  out  some 
interesting  facts  about  the  model  with  regard  to  the 
existence  and  uniqueness  of  the  MLE.  We  give  the  details 
for  the  general  model  and  only  summarize  the  results  for  the 
case  of  identical  marginals. 


-12- 


Let  B=*B j  B2  denote  the  boundary  of  the  parameter  space 
a  of  the  general  model  BVE(X^,X2#6)  where  Bj^  *  [4*0,  X^O,  X2>0] 
and  B2  *  [ X j*0 J  [X2*0].  Note  that  B^  a  whereas  B2  is 
disjoint  from  a,  although  it  is  in  the  closure  of  a.  Using 
(2.4),  the  likelihood  function  is  given  by 

£(X1,X2,6)  *  [X1(X2+6)jni[X2(X1+4) jn24n°exp[-X1s1  -  X2s2  -  6t2J , 

on  a-B^ 

*  [X1X2J  exp[-X^s^  —  X2s2J I ^  j >  on  B^.  (3.1) 

Equating  the  first  partial  derivatives  of  logfc  (X^,X2,6)  on 
a-Bx  to  zero,  we  obtain  the  likelihood  equations 

n^^1  +  n2(Xj+6)  1  * 

n^(X2+6)  *  +  n2X2^  *  s2  (3.2) 

nl (X2+6 >  1  +  n2(Al+5)"1  +  no6  1  *  t2r 

and  the  matrix  Q  of  the  second  partial  derivatives  is  given 
by 
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The  existence  and  uniqueness  properties  of  MLE  are  given  in 
the  following  theorem. 

Theorem  3,1. 

(i)  If  nQ,n1/n2  are  all  non- zero,  the  MLE  of  (A1,A2»6)  is 
unique  and  is  the  unique  root,  belonging  to  R-B^ ,  of 
the  set  of  equations  (3.2). 

(ii)  If  n0=0,  n1>0  and  n2>0,  the  unique  MLE  is  given  by  6=0, 

A  A 

Ajsn/s^,  X2=n/s2. 

(iii)  I£  nQ=0  and  either  n^=0  or  n2=0,  the  MLE  exists  but  i3 
not  unique. 

(iv)  If  nQ>0  and  one  or  both  of  n^  and  n2  are  0,  the  MLE  does 
not  exist  in  the  sense  that  the  supremum  of  the  likelihood 
is  not  attained  within  the  parameter  space  R. 

Proof .  (i)  We  first  note  that  when  n^>0,  i»0,l,2,  the  diagonal 

-2  -2  -2 

matrix  D  =  diagfn^A^  ,  n2X2  ,  ]  is  positive  definite  for 
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all  (X^,X2#6)  c  ft-B^  and  also  it  is  easy  to  verify  that  the 
matrix  -(Q+D)  is  positive  semi-definite.  It  follows  that 
when  (X^.Xjtfi)  e  ft-B^  and  all  n^>0,  the  matrix  Q  is  negative 
definite.  Thus  log  t  is  a  strictly  concave  function  on  ft-Bj. 
Also,  4»0  on  B^  and  as  the  argument  (X^,X2,6)  approaches 
any  point  on  the  boundary  B  or  tends  to  infinity  in  any 
component.  Hence  l  has  a  unique  maximum  within  ft-B^  and  the 
maximum  is  attained  at  the  root  of  (3.2). 

(ii)  When  nQ=0,  n^>0,  n2>0  and  e  ft-B^  Q 

is  again  negative  definite  so  that  log  l  is  strictly  concave 
on  ft-B^.  Since  l  is  continuous  on  B,  it  has  a  unique  maximum 
either  at  an  interior  point  of  ft  or  on  the  boundary  B.  If 
possible,  suppose  the  maximum  occurs  at  an  interior  point 
(X^X^S).  Then  it  must  be  a  root  of  the  equations  (3.2). 
Substituting  these  values  in  (3.2)  and  subtracting  the  first 
two  equations  from  the  third,  we  obtain 


nl(^2+^  1 

-  n^1 

~- 1 

n2l\1+6)  1 

n2X2 

Since  t2“si  >  0  and  t2~s2  *  we  have  (*2+°*  -  1  *2  * 

But  (X^,X2,6),  being  an  interior  point  of  ft,  satisfies 

0<X,<X,+6;  and  we  reach  a  contradiction.  Therefore  supl  »  supl 
1  *  ft  B1 
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and  it  follows  from  (3.1)  that  the  sup  on  is  attained  at 
Aj-n/s^  X2*n/s2. 

(iii)  Consider  the  case  ng*nj=0,  n2*n  so  that  s.j=t2 
and  s2astj, .  Then  we  have 

4(1^, X2, 5)  =  [X2  (X^+6)  ]nexp[- (Aj+5)  t2  -  Ajt^  on 

It  is  easy  to  see  chat  4  is  maximized  at  every  point  (£.,£2,6) 
in  R  satisfying  X2»n/t^  and  X1+S«n/t2.  The  MLE  exists  but 
it  is  not  unique  as  far  as  X^  and  6  are  concerned.  The  case 
n0=rn2=0 *  n^=n  is  entirely  symmetric. 

(iv)  Let  nQ>0,  n2>0  and  n^O  ,  log4  is  again  strictly 
concave  on  R-B^  If  (3.2)  has  a  solution  (A^,A2,6)  e  R-B^, 
we  have  nQ/S*0  as  can  be  seen  from  the  first  and  third 
equations  after  noting  that  Sj=t2  in  this  case.  This  is  a 
contradiction.  Hence  sup4  is  not  attained  at  any  interior 
point  of  (2,  and  on  the  boundary  B^  we  have  4*0.  The  MLE  does 
not  exist.  However,  if  R  is  extended  to  include  B2,  then 
sup4  is  attained  on  R  *  R  B2  at  the  point  £j*0,  X2*r.2/tlf 
6*n/t2  and,  by  convention,  we  may  take  this  to  be  the  MLE. 

The  other  situation  to  be  considered  is  when  ng*n  which 
implies  s^*s2*t^=t2  an<*  hence 

i(X1,X2,6)  *  6nexp(- (X^+X2+5) t^)  on  R-B^ 


0 


otherwise. 
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Sup  2.  is  clearly  not  attained  at  any  point  in  ft  although  it 
is  attained  on  the  extended  set  ft  at  the  point  £^=0,  A2*0, 

A 

S-n/t^.  This  may  be  taken  to  be  the  MLE,  by  convention. 

This  concludes  the  proof  of  the  theorem. 

With  increasing  sample  size,  the  probability  that  N^O 
or  N2=0  approaches  0  exponentially  and  therefore  the  cases 
which  are  important  in  large  samples  are  (i)  and  (ii)  of 
the  above  theorem.  For  (i) ,  a  closed  form  expression  of  the 
MLE  could  not  be  obtained  due  to  the  non-linear  form  of  the 
likelihood  equations.  In  application,  the  estimates  must  be 
computed  by  an  iterative  procedure.  The  unbiased  estimators 
of  AlfA2,5  proposed  by  Arnold  [1]  are  based  on  (NQ,N1,N2,T1) 
and  do  not  use  all  the  components  of  the  minimal  sufficient 
statistic.  In  some  parts  of  the  sample  space,  these  estimates 
are  close  to  the  MLE  while  in  others  they  are  quite  different. 
The  two  sets  of  estimators  are  presented  in  Table  1  for 
comparison.  In  the  first  three  columns,  +(0)  means  that  the 
corresponding  Ni  is  greater  than  (equal  to)  zero.  The  cases 
(Nq,N^,N2)  =  (0,0, n)  and  (+,+,0)  are  not  included  in  the 
table  because  they  follow  by  symmetry  from  (0,n,0)  and 
(+,0,+)  respectively. 


TABLE 

1.  COMPARISON  OP  MLE  AND  UNBIASED  ESTIMATORS 

c  =  <n-l)/n 
n 

Estimators  of  (XlfX2,6) 

N0  Nx  N2 

MLE 

Unbiased 

0  +  + 

(n/S1,  n/S2,  0) 

cn(Nl/Tl'  N2/Tl'  0) 

+  +  + 

Unique  root  of  (3.2) 

cn<VTl’  VTr  W 

0  n  0 

(n/T^  n/T2,  0) 

cn{Nl/Tl'  °'  0) 

n  0  0 

(0,  0,  n/Tx) 

cn(0,  0,  n/Tx) 

+  0  + 

(0,  N2/Tlf  n/T2) 

cn(0,  N2/Tl,  VV 

a  member  in  the  class  of  MLE. 


In  the  model  BVE  (6,3,6)  having  identical  marginals, 
the  derivation  of  the  MLE  is  essentially  similar  and  a  closed 
form  expression  can  be  obtained.  However,  even  in  this 
simplified  model,  there  is  a  part  of  the  sample  space  where 
the  MLE  does  not  exist.  We  state  the  findings  without  proof 
since  the  derivations  are  along  the  same  lines  as  in  Theorem 
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Theorem  3.2.  If  ng<n,  the  MLE  of  (8,6)  in  the  model  BVE(8,8,6) 

A  A 

exists,  is  unique  and  is  given  by  6*0,  6*2n/(tj+t2)  ijf  nQ*0 
and  by 

8  =  (2t1t2)“1[{n2(t2-t1)2+  4n0(2n-n0)t1t2>18  -  n(t2~t1)J 
8  =  (n-nQ)  6  [np+fitj^J -1 

if  nQ>0.  If  ng=n,  the  MLE  does  not  exist. 

In  order  to  investigate  the  asymptotic  properties  of 

the  MLE  in  the  model  BVE  (X.,X-,6),  we  write  0  ■  (X,  ,X_  ,6  ) 

i  2  ~n  In  2n  n 

for  the  MLE  of  0  *  (X1#X2,6)  where  the  suffix  n  indicates 

the  sample  size.  Also  let  Nn  »  *N0n'Nln,N2n^  where  we 

write  N^n  for  ,  i*0,l,2  of  the  previous  sections.  We 

consider  first  the  case  when  the  true  0  is  an  interior 

point  of  ft,  that  is,  0>O.  For  every  n,  Nn  has  the  trinomial 

distribution  TN(n;p)  where  p  =  (p0,p^,p2)  *  X-1  (6 ,X1  ,X2)  and 

X  =  Xj+X2+6.  By  the  Borel-Cantelli  lemma,  almost  surely 

N  >0  for  all  but  a  finite  number  of  n  as  n**-®.  For  all 
-n 

sufficiently  large  n,  0n  is  the  unique  root  of  the  likelihood 
equation  (3.2)  and  hence  §  -►O  with  probability  1  by  the  strong 
consistency  property  of  MLE  (c.f.  Rao  [7J,  p.  300).  In  the 
multiparameter  case,  it  is  necessary  to  use  the  fact  that  the 
log  likelihood  is  dominated  by  an  integrable  function  in  some 
small  neighborhood  of  0  in  order  to  use  the  uniform  strong 
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law.  Further,  the  likelihood  function  (3.1),  restricted  to 
satisfies  the  Cram£r  conditions  (c.f.  Rao  [7],  p.  299) 
for  asymptotic  normality.  The  boundedness  condition  for  the 
third  partial  derivatives  of  log!  in  a  neighborhood  of  0 

easily  follows  as  these  can  be  bounded  by  constants.  Hence 

A 

n^(0n~0)  has  asymptotically  the  trivariate  normal  distribution 
3(0,I)  where  Z”1  =  E(-n-1Q)  is  the  information  matrix 
and  Q  is  given  in  (3.3).  Letting 


a 


X2(X1+6)"2, 


X1U2+6) 


-2 


-  X  diag  (X1,X2,5) 


C 


/  a  0 

|0b 

lab 


and  computing  E(Q),  we  obtain 


(3.4) 


I 


-1 


(3.5) 


The  following  lemma  provides  the  limit  distribution  of  the 
unbiased  estimators. 

Lemma  3.1.  I£  0  e  fl-B^,  the  limiting  distribution  of 
nli(0*-O),  where  0*  •  (n-1) <nTln) (Nln,N2n,N0n)  Is 
trivariate  normal  3(0,Z^)  with  Z^  given  by  (3.4). 
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Proof .  From  the  properties  of  BVE (X^X^S) ,  we  note  that  T^n 
has  the  distribution  G(n,X)  and  it  is  independent  of  Nn 
which  has  a  trinomial  distribution.  Letting  ZR  *  *zin'Z2n'Z3n* 
where 


N 


in 


'in 


Hr  ’  piK  i=1'2  ?  2 


we  see  that  nJ,sZn  is  asymptotically 


/  Pid-P^  -PiP2 


“PlP2  P2<1~P2> 


\ 


(3.6) 


(3.7) 


Employing  the  linear  transformation  Un  »  HZn  ,  where 


it  follows  that  n*U  -  - (0 ,HTH ' ) .  It  is  easy  to  check  that 

~n  j  - 

v  *  P 

V  «  n^(0  -  0  -  U  )  - >  0.  For  example, 

~n  ~n  -  -n 

Vln  -  n1*(Nlnn"1  -  Px)  <nT^  -  X)  — >  0  since  n^W^n"1  -  Pj) 
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-1  P 

has  a  limiting  normal  distribution  and  nT^n  - >  * -  There- 

w  * 

fore  n  (0  -0)  -  , (0,HrH')  and  the  lemma  follows  by  checking 

— n  •*  j  *• 

that  HTH '  *  £1. 

From  (3.4)  and  (3.5)  it  is  clear  that  is  non¬ 

negative  definite  so  that  £^-£  is  non-negative  definite. 

This  has  several  implications  on  the  concentration  of  the 

two  asymptotic  distributions.  However,  as  a  measure  of  the 

* 

asymptotic  efficiency  of  the  vector  estimator  0n  relative  to 
the  MLE  §n,  we  only  employ  the  criterion  of  the  inverse  ratio 

of  their  asymptotic  generalized  variances.  From  (3.5)  and 

*  * 

Lemma  3.1,  the  ARE  of  0  relative  to  0„  is  given  by 

~n  ~n  * 

e(X^,X2,6)  = 


|£|/|£1I  -  (IE.E"1!)'1 


( 1 1  +  I]C|) 


-1 


M  +  A2  .  X1  .  X1X2 

Xl+6  *2+6  (X1+6)2(X2+5) 


■j(fiX^+6X2+X^X2)  ] 

(3.8) 


As  for  the  bounds  of  the  ARE,  we  note  that  e<l  for  all 
(X^,X2,6)  >  0.  e-*-0  if  X ^  and  6  are  fixed  and  Xj-*-®  or  if 

X2  and  6  are  fixed  and  X^-*®.  Secondly,  by  keeping  6  fixed 
and  letting  X^O,  X2+0,  we  have  **•!.  Summarizing  these,  we 


have 
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inf  e(X.,X_,6)  ■  0  ,  sup  e(X.,X-,6)  =  1.  (3.9) 

1  i  n-Bx  A  * 


When  OeB.^,  we  have  6*0.  In  this  case  the  MLE  is  given 

by  X^n*n/S^,  i=l,2,  6=*0,  while  the  unbiased  estimator  is 

*  * 

X±n  «  (n-l)Nin/(nTin) ,  i*l,2,  6  *0.  The  asymptotic  normality 

,1a  a  w  *  * 

of  n  X2n-X2)  and  of  n  (^in~^i»  ^2n~^2^  can  'ae 

established  using  the  above  method.  The  ARB  of  the  unbiased 
estimator  relative  to  the  MLE  and  its  bounds  are  given  by 


e(X^,X2»0)  =  *i*2^1+*2^ 


(3.10) 


inf  e(X^,X2/0)  =  0  ,  3up  ed^rX^fO)  -  j. 
B1  B1 


(3.11) 


The  maximum  efficiency  occurs  when  the  marginals  have  the 
same  scale  parameter  and  the  minimum  occurs  when  X^/Xj-^O 
or  00 . 

(3.9)  and  (3.11)  show  that  the  unbiased  estimators  pro 
posed  in  (1]  ar '  asymptotically  less  efficient  than  the  MLE 
and  the  loss  in  efficiency  is  serious  in  certain  parts  of 
the  parameter  space,  particularly  when  6  is  close  to  0. 
However,  it  should  be  remarked  that  the  unbiased  estimators 
have  a  simple  form  even  in  the  multidimensional  case  while 
the  derivation  of  the  MLE  in  higher  dimensions  is  rather 


tedious . 
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4.  TEST  OF  INDEPENDENCE  IN  BVE(6,6,8) 

In  this  section,  we  restrict  ourselves  to  the  bivariate 
exponential  distribution  with  identical  marginals  which,  as 
noted  earlier,  is  a  plausible  model  in  many  practical  contexts 
where  identical  components  are  connected  in  parallel.  We 
proceed  to  derive  an  optimal  test  for  the  null  hypothesis 
that  the  component  life  times  are  independent  which  is 
equivalent  to  testing  Hq:  6=0  against  6>0.  Without  loss 
of  generality,  we  can  restrict  attention  to  tests  which  are 
functions  of  the  sufficient  statistics  (Nq ,T^ ,V) .  Their 
joint  distribution,  however,  does  not  constitute  an  exponential 
family  and  therefore  the  standard  procedure  for  deriving  an 
optimal  test  in  an  exponential  family  does  not  apply. 

Let  =  {(8,6):  0<8<°°,  0<5<®}  denote  the  parameter 
space  and  «  =  {(8,0):  0<8<°°}  denote  the  subset  specified 
by  the  composite  null  hypothesis.  We  shall  write  0»(8,6) 
to  denote  a  point  in  and  <p  =  $(Nq,T^,V)  a  test  function. 
The  following  lemma  provides  an  essentially  complete  class 
of  level  a  tests. 

Lemma  4.1.  Let  ^  =  {$:  EQ$<ot,  9eu>}  be  the  class  of  level 
a  tests  for  Hq  vs.  and  define  a  class  of  tests  ^  as 


follows : 
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&  =  (♦*:  <>*-1  if  NQ>0,  Rate'S  if  NQ=OK  (4.1) 

Then  ifc  £  and  ^  is  an  essentially  complete  class  of  level 
a  tests. 

Proof .  Under  Hq,  the  probability  of  the  event  [NQ>0]  is 

* 

zero.  Thus,  for  any  test  <p  e  G  and  any  0eQ^  we  have 

E04>*  =  P0(NO>O)  +  Pe(No=O)E0(<HNo=O)  •  (4.2) 

and  Eg =  E0<$>  if  0eaj.  Hence  w  C.  .  Also,  since 
0<*<1,  we  have  P0 (NQ>0)  >  FQ  (<J>  |nq=*0)  P0  (Nq>0)  and  hence 
(4.2)  yields  E0<J>  >  E0<j>  for  all  0  e  n^-w.  Consequently, 

every  test  <|>e  S  has  a  power  function  which  is  dominated  by 
a  test  in  q  and  thus,  by  definition,  %  is  essentially 
complete . 

The  lemma  implies  that  we  only  need  to  look  for  a  UMP 
test  within  the  class  .  A  UMP  level  a  test  if  one 

exists,  will  maximize  E0($o|No=O)  uniformly  in 

*  * . 

subject  to  E0$o  *  E0^oIN2*0^  a  a'  0ew*  This  reduces  the 
problem  to  finding  a  UMP  test  in  the  conditional  problem 
given  that  H2»0  is  observed. 

From  Theorem  2.1,  we  note  that,  conditionally  given 
Nq=P,  T1  and  V  have  the  joint  pdf  given  by 


d 


-25- 


g (t.,v)  =  (-2-S4:6)-(8--^n  exp [- (26+6) t.  -  (B+6)v]  (t.v)*'1, 

1  [T(n)r  1  1 


0  <  t1#  v<® ,  (0,6)  e  8^  (4.3) 


Theorem  4.1.  The  UMP  level  ex  test  of  H  :  6®0  vs.  H. :  6>0 
-  -  -  o  -  l 

for  the  family  of  distributions  (4.3)  exists  and  is  given  by 

*o(tl'v)  =  1  if  2ti/v  >  Fa 

=  0  otherwise,  (4.4) 

where  Fa  is  the  upper  a  point  of  the  central  F  distribution 
with  (2n,2n)  degrees  of  freedom. 

Proof .  For  convenience,  we  make  the  following  transformations: 

tx  -  ux  ,  v  *  2u2 

28+6  =  5  ,  2(6+5)  *  n.  (4.5) 

The  -*>int  pdf  of  U^,  U2  is  given  by 
* 

g (u^ ,u2;£ ,n)  =  c(C)c(n)  exp(-^u1  -  nu2l (u1u2)n_1 

0<ux,  u2<®. 


(4.6) 
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where  c(C)  *  Cn/r(n).  The  transformed  parameter  space  is 

ft  *  {(€,n):  0  <  n/2  <  5  <  n  <  “)  and  the  hypotheses  are 

equivalent  to  HQ:  vs.  H^s  5<n.  Let  w*  *  {(£,£):  0<£<®}. 

To  derive  the  UMP  test,  we  shall  use  the  notion  of  least 

favorable  distributions.  Consider  a  fixed  simple  alternative 
*  * 

(£  1 » n i )  e  ft  -a)  and  let  be  a  suitable  constant,  to  be 

selected  later,  which  satisfies  5^<5o<n^.  Let  X(£o>  be  a 

* 

prior  probability  distribution  on  ft  which  concentrates  mass 

*  * 

1  on  the  single  point  9  =  (E  ,£  )eu>  .  Letting 

O  CO 

gx(u1,u2)  *  /gtajyUj  ;  ?,n)dX(CQ),  we  have 

•j  n-1 

gx(ulfu2)  =  c  (C0)exp(-Co(u1+u2)  ]  (Uj^Uj) 


Consider  the  test  t|<  defined  by 


g(u.,u,  ;  Cwn,)  c(C,)c(n1) 
if  ' 


<=2«o> 


=  0  otherwise. 


(4.7) 


After  some  simplification  of  the  inequality,  ip  is  equivalently 

given  by  i|>=l  if  uj/u2  >  (n^-C0)/ (£0“€j)  and  otherwise. 

Now  we  choose  £  such  that  (n,~?  )/(£  -£,)  *  F  .  Such  a 
o  l  o  o  l  ct 

choice  is  always  possible  because  the  ratio  tends  to  0  and 
00  as  tends  to  ri^  and  respectively.  With  this  choice 
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of  5  and  hence  of  the  prior  distribution  A(£  ),  we  have 
o  o 

i|»*l  if  u./u-  >  P  and  iji«0  otherwise.  Since  under  any 

X  «  Gt 

*  * 

0  ew  ,  Uj/U2  has  a  central  F(2n,2n)  distribution,  we  have 

*  * 

V*«VU2)  *  E9*^^U1,D2^  *  a  ^°r  a11  ®  ew  *  The 

conditions  for  Corollary  5  in  p.  92  of  Lehmann  [5J  are 
satisfied  and  therefore  the  test  4>  is  the  most  powerful 
level  a  test  for  HQ  against  the  simple  alternative  (5^,n^) • 
Transforming  back  to  the  variables  t^  and  v,  we  recognize 
that  is  identical  with  the  test  <j>Q  given  by  (4.4).  As 
the  test  does  not  depend  on  the  particular  alternative 
<^l'nl*'  it:  is  also  the  teat.  This  concludes  the  proof. 
Combining  Lemma  4 . 1  and  Theorem  4 .  i ,  we  have 

Corollary  4.1.  For  testing  Hq:  6=»0  vs .  H^:  5>0  in  the 
distribution  BVE (3,0,6) ,  a  UMP  level  a  test  exists  and  is 
given  by 

<MN0,T1#V)  -  1  if  NQ>0  or  2TX/V  >  Fa 

*  0  otherwise.  (4.8) 


Incidentally,  we  note  that  the  test  (4.8)  can  also  be 
derived  from  a  natural  invariance  consideration.  The 
problem  is  invariant  under  a  common  scale  change  in  the  two 

t 

coordinates,  that  is,  transformations  of  the  form  y^*cy^. 
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I 

y2i*cy2i,  i-l,...,n,  c>0.  On  the  set  of  sufficient  statistics, 

«  I  I 

the  induced  transformation  is  ,  T^-cT^ ,  V  «cv  and  a 

maximal  invariant  is  given  by  (NQ,R)  where  R-2Tj/V.  Conditionally, 

given  NQ*0,  R  is  distributed  as  kP  where  k  »  (2&+d)/(2B+26) 

and  F  nas  a  central  F(2n,2n)  distribution.  For  0<k<l,  the 

family  has  monotone  likelihood  ratio  in  R  and  hence  the 

conditional  tjmp  invariant  test  is  the  same  as  Using 

Lemma  4.1,  it  then  follows  that  the  UMP  invariant  test  is 

the  one  given  by  Corollary  4.1.  Although  it  is  easier  to 

derive  the  test  through  this  invariance  argument,  the  use  of 

least  favorable  distribution  provides  a  stronger  optimality 

property  of  the  test. 

The  test  (4.8),  being  invariant  under  common  scale 
change,  has  a  power  function  which  depends  only  on  p«5/B 
which  is  the  maximal  invariant  in  the  parameter  space. 

Using  (4.2)  and  the  distributional  properties  mentioned 
above,  the  power  function  y(p)*Ep$  is  given  by 


Y  (p) 


,  2B  x 

{2$+7' 


t  26  > 


\W(2B+6)F 

P(SW$)  ■ 


=  1  -  (2/(2+P)]nH(2Fa(l+p)/(2+p))  (4.9) 


where  H(»)  is  the  cdf  of  a  central  F(2n,2n).  For  given  n 
and  p,  the  power  y(P)  can  be  easily  computed  with  the  help 
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o£  am  incomplete  beta  function  table.  The  power  is  strictly 
increasing  in  p  for  every  n.  To  see  this,  let  q(p)»  2Fa(l+p)/(2+p) 
and  note  that  the  derivative  of  y(p)  is  proportional  to 
J(p)  »  {nH[q(p)l  -  q (p)h tq (p)  ] }  where  h(*)  is  the  pdf  of 
F(2n,2n).  For  n>2,  the  pdf  h(x)  is  strictly  concave  over 
0  to  the  mode  (n-l)/(n+l) ,  so  that  2H(x)  >  xh(x)  for  all 
x>0  and  hence  J(p)>0.  The  case  n«l  is  immediate  since  h(x) 
is  monotone  decreasing. 


Remark .  It  is  apparent  from  the  proof  of  Theorem  4.1  that  a 

UMP  test  for  testing  Hq:  vs.  H. :  £<n  can  be  constructed 

in  the  saune  way  even  when  U1  and  U2  are  independent  Gfn^C) 

and  g(n2,n)  respectively,  and  the  parameter  space  is 

ft  =  {(£»n):  0<£<n<°°},  and  n^  and  n2  may  be  different.  For 

an  application  in  life  testing,  let  X1 , . . . ,X  and  Y.,...,Y 

x  n,  x 


‘1  *  n2 
be  two  independent  random  samples  from  f (x)  *  gexp(-nx)  and 

g(y)  **  Cexp(-Cy)  respectively.  Epstein  and  Tsao  13]  con¬ 
sidered  the  problem  of  testing  H^:  against  two-sided 

alternatives  and  showed  that  the  UMP  unbiased  test  rejects 
for  large  and  small  values  of  X/Y.  The  above  theorem  shows 
that  for  one-sided  alternatives  5<n»  the  test  which 


rejects  for  large  values  of  X/Y  is  UMP  rather  than  just  UMP 
unbiased.  Same  property  holds  with  the  usual  modification 
of  the  test  statistic  when  the  samples  are  censored  at  fixed 
numbers  of  order  statistics. 
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